ABSTRACT
Purpose: This study investigated the effect of interview format changes (in-person to virtual, one-to-one to multiple-to-one) necessitated by the COVID-19 travel restrictions on preliminary fellowship candidate ranking variabilities. Design: Cross-sectional observational study. Method: In 2018 and 2019, the glaucoma fellowship interviews were conducted in-person in a one-to-one format, whereas in 2020, interviews were virtual and in a multiple (interviewers)-to-one (candidate) format. We compared ranking ranges of interviewers within the same virtual room (WSR) and not within the same virtual room (NWSR) to assess the effect of WSR versus NWSR on ranking variabilities. We also compared ranking categories ("accept," "alternate," and "pass") agreements between 2018, 2019, and 2020 to assess the effect of virtual versus in-person interviews on ranking variabilities. Results: NWSR and WSR mean rankings differed by 1.33 (95% confidence interval difference 0.61 to 2.04, p = 0.0003), with WSR interviewers having less variability than NWSR pairs. The variability between 2018/2019 (in-person interviews) and 2020 (virtual interviews) showed no differences between in-person and virtual interviews (weighted Kappa statistic 0.086 for 2018, 0.158 for 2019, and 0.101 for 2020; p < 0.05 for all years). The overall least attractive candidate has the lowest variability; the most attractive candidate has the second lowest variability. Conclusion: Grouping interviewers WSR during the interview decreased ranking variabilities compared to NWSR, while a change from in-person to virtual interview format did not increase the ranking variabilities. This suggests that the decreased nonverbal interactions in virtual interviews do not decrease interviewers' perceptions as applied to preliminary rankings.
Subject(s)
Betacoronavirus , Coronavirus Infections/history , Disease Outbreaks/history , Ophthalmologists/history , Pandemics/history , Pneumonia, Viral/history , COVID-19 , China/epidemiology , Coronavirus Infections/diagnosis , Coronavirus Infections/epidemiology , Health Personnel , History, 20th Century , History, 21st Century , Humans , Pneumonia, Viral/diagnosis , Pneumonia, Viral/epidemiology , SARS-CoV-2ABSTRACT
Objective : To investigate the effect of interview format changes (in-person to virtual, one-to-one to multiple-to-one) necessitated by the COVID-19 travel restrictions on candidate ranking variabilities. Method : In 2018/2019, the glaucoma fellowship interviews were conducted in-person and one-to-one, whereas in 2020, interviews were virtual and multiple (interviewers)-to-one (candidate). We compared ranking ranges of interviewers within the same virtual room (WSR) and not within the same virtual room (NWSR) to assess the effect of this change on ranking variabilities. We also compared ranking categories ("accept," "alternate," and "pass") agreements between in-person and virtual interviews to assess the effect of this change on ranking variabilities. Results : NWSR and WSR mean rankings differed by 1.33 (95% confidence interval difference 0.61 to 2.04, p = 0.0003), with WSR interviewers having less variability than NWSR pairs. The variability of in-person interviews and later virtual interviews showed no differences (weighted Kappa statistic 0.086 for 2018, 0.158 for 2019, and 0.101 for 2020; p < 0.05 for all years). The overall least attractive candidate has the lowest variability; the most attractive candidate has the second lowest variability. Conclusion: Grouping interviewers decreased ranking variabilities, while a change from in-person to virtual interview format did not increase the ranking variabilities.